Image capturing apparatus and control method therefor

ABSTRACT

An image capturing apparatus having a plurality of executable image blurring correction modes selects an image blurring correction mode to be executed from among the executable image blurring correction modes in accordance with an image capturing situation, and executes the selected image blurring correction mode. The image capturing apparatus has a plurality of display items respectively associated with the image blurring correction modes, and displays the display item corresponding to the image blurring correction mode under execution on a display screen.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image capturing apparatus, and moreparticularly to an image capturing apparatus having a camera shakecorrection function and a control method for the same.

2. Description of the Related Art

Image capturing apparatuses equipped with image blurring correctiondevices (also called camera shake correction devices) for detectingshake of the image capturing apparatuses and driving photographinglenses to correct image blur caused due to the detected shake are known.With regard to image capturing apparatuses having such image blurringcorrection devices, a camera shake alert display function is known,which is used to make recognition of the on/off state of image blurringcorrection easy, and to notify of whether or not camera shake based on acamera shake shutter speed limit is occurring. (See Japanese PatentLaid-Open No. 2007-279394)

In recent years, there have been various image blurring correctiontechniques, such as techniques for correcting not only angle shake butalso shift shake, which occurs when the camera undergoes translationalmovement, and for broadening the anti-vibration range at the wide-angleend side during moving image recording and improving image blurringcorrection effect on large camera shake caused due to shooting whilewalking, and the like. Appropriate image blurring correction control isperformed upon the functions suitable for an image capturing situationbeing automatically selected from among several types of image blurringcorrection functions prepared in advance.

Meanwhile, in Japanese Patent Laid-Open No. 2007-279394 mentioned above,a problem arises in that as for the status of image blurring correction,only information on the on/off state is displayed, and a user cannotrecognize which function among those various image blurring correctionfunctions is currently being used.

SUMMARY OF THE INVENTION

The present invention was made in consideration of the above-describedproblem, and according to one embodiment thereof, an image capturingapparatus in which a user can easily recognize the image blurringcorrection control under execution is provided.

According to one aspect of the present invention, there is provided animage capturing apparatus capable of executing a plurality of imageblurring correction modes, comprising: a correction unit configured toselect an image blurring correction mode from among the plurality ofimage blurring correction modes in accordance with an image capturingsituation and execute the selected image blurring correction mode; and adisplay unit configured to have a plurality of display itemsrespectively associated with the plurality of image blurring correctionmodes, for selecting a display item corresponding to the image blurringcorrection mode under execution by the correction unit from among theplurality of display items, and display the selected displayed item on adisplay screen.

Also, according to an aspect of the present invention, there is providedan image capturing apparatus capable of selecting and operating in oneof a moving image capturing mode and a still image capturing mode, andexecuting a plurality of image blurring correction modes, comprising: acorrection unit configured to select an image blurring correction modefrom among the plurality of image blurring correction modes inaccordance with an image capturing situation and execute the selectedimage blurring correction mode, a group of a plurality of image blurringcorrection modes for the moving image capturing mode and a group of aplurality of image blurring correction modes for the still imagecapturing mode respectively including at least one different imageblurring correction mode; and a display unit configured to have aplurality of display items respectively associated with the plurality ofimage blurring correction modes, for selecting a display itemcorresponding to the image blurring correction mode under execution bythe correction unit from among the plurality of display items, anddisplay the selected displayed item on a display screen, wherein an itemto be displayed is different between the moving image capturing mode andthe still image capturing mode.

Furthermore, according to an aspect of the present invention, there isprovided a method for controlling an image capturing apparatus having aplurality of executable image blurring correction modes, the methodcomprising: a step of selecting an image blurring correction mode fromamong the plurality of image blurring correction modes in accordancewith an image capturing situation and executing the selected imageblurring correction mode, and a step of selecting, from among aplurality of display items that are respectively associated with theplurality of image blurring correction modes, a displayed itemcorresponding to the image blurring correction mode that is underexecution in the executing step.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments (with reference to theattached drawings).

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a digital camera serving as an imagecapturing apparatus according to an embodiment;

FIG. 2 is a block diagram showing an internal configuration of an imageblurring correction unit 104;

FIG. 3 is a diagram showing display icons corresponding to shakecompensation modes for each image capturing mode;

FIGS. 4A and 4B are flowcharts showing processing for deciding the shakecompensation mode according to an embodiment;

FIGS. 5A and 5B are diagrams showing exemplary display of shakecompensation mode display icons;

FIG. 6 is a flowchart showing processing for deciding the shakecompensation mode icon according to an embodiment; and

FIG. 7 is a flowchart showing processing for deciding the shakecompensation mode icon according to an embodiment.

DESCRIPTION OF THE EMBODIMENTS

An embodiment of the present invention will be hereinafter described indetail with reference to the drawings. Note that in the followingdescription of the embodiment, a digital camera 1 capable of capturingstill images and moving images is taken as an example of an imagecapturing apparatus having a plurality of executable shake compensationmodes.

FIG. 1 is a block diagram showing an exemplary configuration of thedigital camera 1, which is an image capturing apparatus according to theembodiment. In FIG. 1, a zoom unit 101 includes a zoom lens whosemagnification ratio is variable. A zoom driving controller 102 controlsdriving of the zoom unit 101. A correcting lens unit 103 has a shiftlens capable of moving on a plane perpendicular to an optical axis tochange its own position. An image blurring correction unit 104 controlsdriving of the correcting lens unit 103 to correct image blur caused dueto camera shake or the like.

An aperture/shutter driving controller 106 controls driving of anaperture/shutter unit 105. A focus unit 107 includes a lens thatperforms focus adjustment. A focus driving controller 108 controlsdriving of the focus unit 107. The zoom unit 101, the correcting lensunit 103, the aperture/shutter unit 105, and the focus unit 107 arearranged within a photographing lens for forming an object image on animaging unit 109.

The imaging unit 109 converts an optical image formed through the lensgroup into an electric signal. An image capturing signal processing unit110 performs processing for converting the electric signal output by theimaging unit 109 into a video signal. A video signal processing unit 111processes the video signal output by the image capturing signalprocessing unit 110 according to intended use. A display unit 112displays a setting menu, captured images, images (through-the-lensimage) based on signals output by the video signal processing unit 111,or the like as necessary. A power source unit 113 supplies power to theentire system. An external input/output terminal unit 114 externallyinputs and outputs communication signals and video signals. An operationunit 115 includes various switches and buttons for operating the imagecapturing apparatus. A storage unit 116 stores various data such asvideo information. A posture information control unit 117 determinesposture of the image capturing apparatus and provides postureinformation. A camera system controller 118 controls the overall imagecapturing apparatus.

Next, operation of the digital camera 1 configured as described abovewill be described. The operation unit 115 has a shutter release button(not shown) serving as an instruction member configured such that afirst switch (SW1) for instructing an image capturing preparationoperation and a second switch (SW2) for instructing an image capturingoperation are turned on in this order in accordance with the degree ofpressing. The first switch (SW1) is turned on upon the shutter releasebutton being half-pressed, and the second switch (SW2) is turned on uponthe shutter release button being completely pressed.

Upon the first switch (SW1, image capturing preparation instruction)being turned on, the focus driving controller 108 drives the focus unit107 to perform focus adjustment, and the aperture/shutter drivingcontroller 106 drives the aperture/shutter unit 105 to set anappropriate exposure. Upon the second switch (SW2, image capturinginstruction) being turned on, an optical image is exposed on the imagingunit 109, and image data obtained based on an electric signal convertedby an image sensor is stored in the storage unit 116.

At this time, if an instruction to turn on the image blurring correctionis given by the operation unit 115, the camera system controller 118instructs the image blurring correction unit 104 to perform an imageblurring correction operation, and the image blurring correction unit104, upon receiving this instruction, performs an anti-vibrationoperation until an instruction to turn off the image blurring correctionis given.

If the operation unit 115 is not operated for a certain period of time,the camera system controller 118 gives an instruction to interrupt powerof a display provided in the display unit 112 to save electricity.

In the digital camera 1, a still image capturing mode for capturingstill images or a moving image capturing mode mainly for capturingmoving images can be selected by operating the operation unit 115.Therefore, operation settings for each actuator (variable element) thatconstitutes the digital camera 1 can be changed in the respective imagecapturing modes.

Note that upon an instruction to change the magnification ratio with thezoom lens being input via the operation unit 115, the zoom drivingcontroller 102 that receives the instruction via the camera systemcontroller 118 drives the zoom unit 101 and moves the zoom lens to aninstructed zoom position. Further, the focus driving controller 108drives the focus unit 107 and performs focus adjustment based on imageinformation processed by the image capturing signal processing unit 110and the video signal processing unit 111.

FIG. 2 is a block diagram showing an internal configuration of the imageblurring correction unit 104.

A shake detection unit 201 detects shake of the digital camera 1 in anormal posture (a posture in which the longitudinal direction of animage frame is substantially aligned with the horizontal direction) inthe vertical and horizontal directions (pitch and yaw directions) andoutputs a shake signal. The shake detection unit 201 may be, forexample, a sensor such as a vibration gyro or an acceleration sensor,and may detect motion vectors between images or detect vibration basedon an external force applied to the correcting lens unit 103. Further, aplurality of different types of sensors may also be used. For example,if the shake detection unit 201 is a gyro sensor, it detects angularvelocity components of vibration of the digital camera 1 in the verticaland horizontal directions and outputs an angular velocity signal.

The shake detection unit 201 includes a pitch-direction shake detectionunit 201 a and a yaw-direction shake detection unit 201 b that serve asa vibration detection means for detecting vibration applied to thedigital camera 1. The pitch-direction shake detection unit 201 a detectsan angular velocity component in the pitch direction in vibration of thedigital camera 1 in a normal posture (a posture in which thelongitudinal direction of an image frame is substantially aligned withthe horizontal direction) in the vertical direction (pitch direction),and outputs a shake signal (e.g., an angular velocity signal). Theyaw-direction shake detection unit 201 b detects an angular velocitycomponent in the yaw direction in vibration of the digital camera 1 inthe normal posture in the horizontal direction (yaw direction), andoutputs a shake signal (angular velocity signal). Note that in thepresent embodiment, an optical axis extending towards an object is aZ-axis, the vertical direction of the digital camera 1 is a Y-axis, andthe horizontal direction thereof is an X-axis. Accordingly, shake in thevertical direction (around the X-axis) of the digital camera 1 is in thepitch direction, and shake in the horizontal direction (around theY-axis) is in the yaw direction.

An image blurring correction control unit 202 a computes a correctinglens position control signal in the pitch direction based on the shakesignal of the pitch-direction shake detection unit 201 a. Similarly, theimage blurring correction control unit 202 b computes a correcting lensposition control signal in the yaw direction based on the shake signalof the yaw direction shake detection unit 201 b. The correcting lensposition control signals respectively in the pitch and yaw directionsare signals indicating drive target positions of the correcting lensunit 103. Hall effect sensors (position detection means) in positiondetection units 205 a and 205 b detect the position of the correctinglens unit 103 in the pitch direction and the yaw direction by detectinga magnetic field of a magnet attached to the correcting lens unit 103,and outputs a position signal. In the present embodiment, the Halleffect sensors are used as the position detection means, but positiondetection methods such as a PSD (Position Sensitive Detector) mayalternatively be used.

A PID unit 203 a and a PID unit 203 b respectively calculate a controlamount from a deviation between the correcting lens position controlsignals being output by the image blurring correction control units 202a and 202 b and the position signals output by the position detectionunits 205 a and 205 b, and output drive command signals. A drive unit204 a and a drive unit 204 b, which serve as driving means, drive thecorrecting lens unit 103 respectively based on the drive command signalssent from the PID units 203 a and 203 b. Thus the PID units 203 a and203 b perform feedback control such that the position signals convergeinto the correction position control signals sent from the imageblurring correction control units 202 a and 202 b, respectively.

The pitch-direction correcting lens position control signal of the imageblurring correction control unit 202 a computed based on the shakesignal from the pitch-direction shake detection unit 201 a is a signalindicating a movement target position (image blurring correctionposition) in the pitch direction. Similarly, the yaw-directioncorrecting lens position control signal of the image blurring correctioncontrol unit 202 b computed based on the shake signal from theyaw-direction shake detection unit 201 b is a signal indicating amovement target position (image blurring correction position) in the yawdirection.

Accordingly, the position of the correcting lens unit 103 is moved in adirection in which image blur caused by shake of the digital camera 1 iscorrected in accordance with the correcting lens position controlsignals respectively output by the image blurring correction controlunits 202 a and 202 b. Thus the correcting lens unit 103 that performsimage blurring correction moves in up-down and left-right directionsperpendicular to the optical axis, and is capable of preventing blurringwhen shaking of the digital camera 1 occurs.

Next, an outline of the operation of the image capturing apparatushaving the above-described configuration according to the presentembodiment will be described. Returning to FIG. 1, the operation unit115 includes an anti-vibration switch that enables selection of a shakecompensation (image stabilization) mode. Upon the shake compensationmode being selected by the anti-vibration switch, the camera systemcontroller 118 instructs the image blurring correction unit 104 toperform an anti-vibration operation. The image blurring correction unit104, upon receiving this instruction, performs the anti-vibrationoperation (image blurring correction operation) until an anti-vibrationoff instruction is given. The operation unit 115 also includes an imagecapturing mode selection switch that enables selection of one of thestill image capturing mode and the moving image capturing mode, and iscapable of changing operation conditions for each actuator in therespective image capturing modes. In an anti-vibration mode, the camerasystem controller 118 and the image blurring correction unit 104effectively perform image blurring correction by selectively using someof the shake compensation modes in accordance with an image capturingstatus.

The operation unit 115 also includes the shutter release buttonconfigured such that the first switch (SW1) and the second switch (SW2)are turned on in this order in accordance with the degree of pressing.The switch SW1 is turned on upon the shutter release button beinghalf-pressed, and the switch SW2 is turned on upon the shutter releasebutton being completely pressed. Upon the switch SW1 being turned on,the focus driving controller 108 drives the focus unit 107 to performfocus adjustment, and the aperture/shutter driving controller 106 drivesthe aperture/shutter unit 105 to set an appropriate exposure. Upon theswitch SW2 being turned on, image data obtained from an optical imageexposed on the imaging unit 109 is stored in the storage unit 116.

Further, the operation unit 115 includes a moving image recordingswitch. Movie image capturing is started after this switch is pressed,and this moving image recording is terminated upon the switch beingpressed again. The operation unit 115 also includes a playback modeselection switch that enables selection of a playback mode, which stopsthe anti-vibration operation during the playback mode.

The operation unit 115 also includes a magnification ratio change switchfor giving an instruction to change a zoom magnification ratio. Upon theinstruction to change the zoom magnification ratio being given by themagnification ratio change switch, the zoom driving controller 102 thatreceives the instruction via the camera system controller 118 drives thezoom unit 101 to move the zoom unit 101 to an instructed zoom position.At the same time, the focus driving controller 108 drives the focus unit107 to perform focus adjustment based on the image information sent fromthe imaging unit 109 and processed by the respective signal processingunits (110 and 111).

FIG. 3 shows an example of the shake compensation modes for therespective image capturing modes and display items (icons are used inthe present embodiment) associated with the respective shakecompensation modes. Selectable shake compensation modes are differentbetween still image capturing (in the still image capturing mode) andmoving image capturing (in the moving image capturing mode). In thepresent embodiment, during still image capturing, a mode suitable forthe shooting situation is selected from among four shake compensationmodes, namely normal still image, panning, shift shake correction, andtripod modes, and the selected mode is executed. During the moving imagecapturing, a mode suitable for the shooting situation is selected fromamong five shake compensation modes, namely normal moving image,constant point capturing (fixed point capturing), large shakecorrection, shift shake correction, and tripod modes, and the selectedmode is executed. That is, in the still image capturing mode and themoving image capturing mode, some of the shake compensation modes arethe same and the others are different to suit the characteristics of therespective image capturing modes. A specific example of each of theexecutable shake compensation modes will be hereinafter described.

First, the shake compensation modes for still image capturing will bedescribed.

Normal Still Image Mode

This is a shake compensation mode suitable for normal hand-held imagecapturing, which corrects angle shake caused due to hand-held imagecapturing while a user is holding the camera somewhat firmly. Note thatin the shake compensation modes other than the shift shake correctionmode described later, mainly angle shake solely is corrected.

Panning Mode

This is a mode in which when the camera is moved in one direction at acertain speed or faster for a fixed period of time, such as during imagecapturing while moving the camera to follow a moving object, imageblurring correction in the camera moving direction is stopped, and imageblurring correction is performed only on components orthogonal to themoving direction. That is, in the panning mode, image blurringcorrection in the shake direction is stopped after shake occurs in afixed direction for a predetermined period of time. The camera can enterthe panning mode for the respective movements in the up-down directionand the left-right direction, and is applied when, for example, thecamera moves in a fixed direction at an angular velocity of 30degrees/second for 0.5 seconds or longer.

Shift Shake Correction Mode

Shift shake, which is likely to occur when the distance to a main objectis short and the image capturing magnification ratio is large, such asduring macro photography, is corrected. To compute a shift shake amounthere, a sensor for detecting an acceleration applied to the camera isnecessary. Further, in the shift shake correction mode, both kinds ofcamera shake, namely angle shake and shift shake, are corrected. Thatis, the shift shake correction mode is a correction mode for correctingnot only camera angle shake but also shift shake that occurs when thecamera undergoes translational movement mainly in a macro area.

Tripod Mode

Image blurring correction is stopped when a camera swing amount (camerashake amount) is small, such as when the camera is set up on a tripod.The reasons for stopping image blurring correction include preventing acaptured image from shaking while the camera is stationary, such asduring long exposure capturing, due to low-frequency fluctuation noiseoutput by the angular velocity sensor. Here, instead of stopping theimage blurring correction, a method of eliminating low-frequencyfluctuation components by raising cutoff of a high-pass filter used incamera shake amount computation may alternatively be used.

Next, the shake compensation modes for moving image capturing will bedescribed. Note that the “shift shake correction mode” and the “tripodmode” are the correction modes executed in both image capturing modesfor still image capturing and moving image capturing.

Normal Moving Image Mode

This is a normal shake compensation mode used during hand-held movingimage capturing, where angle shake caused due to hand-held imagecapturing while the camera is held somewhat firmly is corrected. Here,in the moving image mode, anti-vibration settings different from thosein the normal still image mode is configured to improve the viewobtained by panning.

Constant Point Capturing Mode (Fixed Point Capturing Mode)

This mode is executed mainly at the telephoto end side, and the purposeof this mode is to enhance the anti-vibration effect on a lowerfrequency when the focal length is a predetermined value (e.g., 100 mm,according to conversion to 35 mm image sensor) or larger and the camerashake amount is a predetermined amount or smaller, and to thus preventvibration more reliably than usual. The reason therefor is that duringconstant point capturing (fixed point capturing), shake, such as bodyshake, of a lower frequency than camera shake occurs even if the camerais firmly held, and that shake is conspicuous especially at thetelephoto end side with a long focal length. In this constant pointcapturing mode (fixed point capturing mode), more weight is put onprevention of body shake (low-frequency shake) occurring when the camerais firmly held than on a bad view obtained by panning, and a distantobject is shot in a firmly stopped state. That is, the constant pointcapturing mode (fixed point capturing mode) is a mode for enhancing theimage blurring correction effect than usual when the shake amount at thetelephoto end side is smaller than a predetermined amount.

Large Shake Correction Mode

This mode is executed mainly on the wide-angle end side with respect tolarge camera shake occurring during image capturing while walking, forexample. To correct large shake, the anti-vibration range on thewide-angle end side is broadened, and panning processing is performedusing a method other than the one normally used. That is, the largeshake correction mode is a correction mode for broadening the imageblurring correction range on the wide-angle end side and thus enhancingthe image blurring correction effect more than usual.

Next, shake compensation mode determination processing will be describedusing FIGS. 4A and 4B.

In S401, whether the digital camera 1 is in the still image capturingmode or the moving image capturing mode is determined. In S401, if thedigital camera 1 is in the still image capturing mode (NO at S401), theprocessing proceeds from S401 to S407. In S407, whether or not an objectdistance obtained by the focus driving controller 108 is equal to orsmaller than a threshold D is checked, and if the object distance isequal to or smaller than a threshold D, it is determined that the shakecompensation mode is the shift shake correction mode, and the processingproceeds to S408. If the object distance is larger than the threshold D,the processing proceeds to S408 without determination. Note thatdetermination may be performed using an index other than the object,such as the image magnification ratio. The object distance may beactually measured by using a distance measuring sensor. Also, the objectdistance may be determined by autofocus operation result. In this case,for example, the object distance can be obtained from calculation resultof autofocus operation, position of focusing lens, or the like.Furthermore, index other than the object, such as image magnification,may be used for determining the object distance.

Next, in S408, if a duration during which an absolute value |S| of thecamera shake amount is equal to or smaller than a threshold S1 isdetermined to be equal to or larger than a threshold T1 [second] (e.g.,3 seconds), it is determined that the shake compensation mode is thetripod mode, and the shake compensation mode determination ends. Notethat determination of the tripod mode is performed using the absolutevalue of the camera shake amount here, but it may alternatively beperformed employing a method using an amplitude and/or a frequency ofcamera shake.

If the fluctuation amount absolute value |S| is equal to or larger thanS1, or if the fluctuation amount absolute value |S| is equal to orsmaller than S1 while the duration is equal to or smaller than T1, theprocessing proceeds to S409. In S409, it is determined whether or notshake continues in one direction and the absolute value |S| of thecamera shake amount is equal to or larger than a threshold S3, and theshake compensation mode is determined to be the panning mode ifconditions are satisfied, and the shake compensation mode determinationends. Here, it is assumed that the threshold of the duration is T3[second] (e.g., 0.5 seconds). Note that aside from the shake amountabsolute value and the duration, an object moving speed may be detectedand used as a parameter in panning mode determination. If the conditionsare not satisfied in S409 (NO in S409), the shake compensation mode isdetermined to be the normal still image mode, which is the defaultsetting, and the shake compensation mode determination ends.

In S401, if the digital camera 1 is in the moving image capturing mode(YES at S401), the processing proceeds from S401 to S402.

In S402, as in S407, whether the object distance is equal to or smallerthan a threshold D is checked. If the object distance is equal to orsmaller than the threshold D or shorter (YES at S402), the shakecompensation mode is determined to be the shift shake correction mode.Note that with regard to the object distance at this time, the distanceto the object may be actually measured by using a distance measuringsensor, but an autofocus result may also be used. In this case, a resultof the object distance computation based on the autofocus result, or aresult of computation using the focus lens position or the like may beused as the object distance. Note that determination may be performedusing an index other than the object, such as an image magnificationratio.

Next, in S403, as in S408, whether or not the shake compensation mode isthe tripod mode is determined. In S403, if the shake compensation modeis determined to be the tripod mode (YES at S403), the shakecompensation mode determination ends. If, in S403, the shakecompensation mode is not determined to be the tripod mode (NO at S403),the processing proceeds to S404. Here, determination in S402 and S403 isthe same as that for the still image capturing mode and the detaileddescription thereof will be omitted, but the thresholds D, S, S1, andT1, or the like may be different between the still image capturing modeand the moving image capturing mode.

In S404, whether a focal length set by the zoom driving controller 102is equal to or larger than a threshold f1 (e.g., a 35 mm imagesensor-equivalent focal length of 100 mm) is checked. In S404, if thefocal length is equal to or larger than the threshold f1, the processingproceeds to S405, and if it is determined that the duration during whichthe fluctuation amount absolute value |S| is equal to or smaller thanthe threshold S2 has continued for a threshold T2 [second] (e.g., 2seconds) or longer, the shake compensation mode is determined to be theconstant point capturing mode (fixed point capturing mode). Note that inthe present embodiment, the shake compensation mode is determined to bethe constant point capturing mode (fixed point capturing mode) if thefocal length is equal to or larger than the threshold f1, but the cameramay be caused to enter this mode by operating the operation unit 115, ora hysteresis may be provided by providing two different thresholds,namely a threshold indicating that the camera enters the constant pointcapturing mode (fixed point capturing mode) and a threshold indicatingthat the camera exits the constant point capturing mode (fixed pointcapturing mode).

Meanwhile, if in S404 the focal length is equal to or smaller than f1,the processing proceeds to S406, and whether or not the focal length isequal to or smaller than f2 (where f2 is smaller than f1) is checked.If, in S406, the focal length is equal to or smaller than f2, the shakecompensation mode is determined to be the large shake correction mode,and the shake compensation mode determination ends. Note that the methodfor large shake correction mode determination may be based on the sizeor frequency of the shake amount. If determination in S405 and S406 is“NO”, the shake compensation mode is determined to be the normal movingimage mode, and the shake compensation mode determination ends.

Note that the fluctuation amount thresholds in the determination herehave the relationship of S1<S2<S3. The shake compensation determinationprocessing based on the image capturing state of the camera and thecamera shake amount has been described above, but it is an example, andit is also possible to use other parameters and conditions. Furthermore,even if not all compensation modes describe above are available, theprocessing in the present invention can be executed as long as two ormore shake compensation modes are available, and other shakecompensation modes than those mentioned above may also be used. Forexample, a rotational shake correction mode for correcting shakeoccurring around an optical axis, and a mode for correcting a tilt or atrapezium distortion at the time of the moving image capturing mode mayalso be added. Of course, a shake compensation off mode and an iconindicating this mode may also be used, and the icon may have a differentcolor from usual icons for the purpose of warning.

As described above, the shake compensation modes include a group of aplurality of shake compensation modes for the moving image capturingmode and a group of a plurality of shake compensation modes for thestill image capturing mode. Further, at least one shake compensationmode to be used is different between the shake compensation modes forthe moving image capturing mode and those for the still image capturingmode. So far, examples of various shake compensation modes have beendescribed, while aside from the above-described modes, shakecompensation modes with different characteristics may be applieddepending on various image capturing situations. Further, in addition tothe correction mode based on optical anti-vibration, a correction modebased on electronic anti-vibration using image synthesis or motionvectors may also be used in combination.

FIG. 3 shows an example of icons serving as display items associatedwith the respective shake compensation modes. Note that the types oficon shown in FIG. 3 are exemplary icons that represent the respectiveshake compensation modes. Next, display of the shake compensation modeicons in the image capturing apparatus according to the presentembodiment will be described with reference to FIGS. 5A and 5B.

In FIG. 5A, an icon corresponding to the shake compensation mode underexecution selected in accordance with an image capturing situation and acamera shake status is displayed at the upper right of the displayscreen. The camera system controller 118 selects the shake compensationmode for performing optimum image blurring correction based oninformation on the selected image capturing mode, the camera shakeamount, the focal length, the object distance, and the like, andexecutes the selected mode. Note that known processing can be appliedwhen the shake compensation mode is thus selected. The camera systemcontroller 118 then displays an icon corresponding to the shakecompensation mode under execution on the display screen of the displayunit 112 to notify the user of which shake compensation mode has beenselected and is under execution. The image capturing situation and thecamera shake status vary moment-by-moment, and upon the shakecompensation mode being switched in accordance with the situation, theicon display is also switched in synchronism with the switching of themode.

If whether or not the respective shake compensation modes need to beexecuted is determined separately, in some cases the situation of imagecapturing operation may correspond to a correction mode in which severalshake compensation modes need to be executed. For example, when an imageof a close object is being captured by using macro photography (i.e.,the object distance is short) during moving image capturing at thetelephoto end side while the camera is firmly held, both the shift shakecorrection mode and the constant point capturing mode (fixed pointcapturing mode) can be the modes to be executed. If there are severalshake compensation modes to be executed as mentioned above, those shakecompensation modes may be caused to work simultaneously, and all iconscorresponding to those modes may be displayed as shown in FIG. 5B.

Alternatively, the display priorities of the icons may be decided inadvance, and if there are several shake compensation modes to beexecuted, those shake compensation modes may be caused to worksimultaneously, while an icon to be displayed may be decided inaccordance with the display priorities. For example, among the iconscorresponding to several shake compensation modes to be executed, onlythe icon of the highest display priority may be displayed. Further,execution priorities of the shake compensation modes may be set, and ifthere are several shake compensation modes to be executed, one or apredetermined number of shake compensation modes may be selected andexecuted in accordance with the execution priorities. Also in this case,the display icons corresponding to all shake compensation modes underexecution may be displayed, or only the icon of the highest displaypriority may be displayed.

Next, processing for displaying the shake compensation mode icons willbe described with reference to FIG. 6. Note that FIG. 6 shows an exampleof processing for displaying the icon of the highest display priority.In the processing shown in FIG. 6, the display priorities for the movingimage capturing mode is set in the order of the “tripod mode”, the“constant point capturing mode (fixed point capturing mode)”, the “shiftshake correction mode”, the “large shake correction mode”, and the“normal moving image mode”. The priorities for the still image capturingmode is set in the order of the “tripod mode”, the “panning mode”, the“shift shake correction mode”, and the “normal still image mode”.

Note that if several shake compensation modes are selected based on theimage capturing situation as mentioned above, the selected shakecompensation modes may be caused to work simultaneously, or only a shakecompensation mode of a high priority among the selected shakecompensation modes may be executed. In the configuration in which theshake compensation mode of a high priority is executed, the iconcorresponding to the shake compensation mode under execution isdisplayed on the display screen. Further, depending on situations atdifferent times, several shake compensation modes may be executed, or asingle shake compensation mode of a high priority may be executed.

The camera system controller 118 decides which of the above-describedshake compensation modes to execute based on information on the imagecapturing status of the image capturing apparatus such as the imagecapturing mode, the camera shake amount, the focal length, the objectdistance, or the like, and executes the decided shake compensation mode.The icon display determination processing shown in FIG. 6 is performedin a predetermined cycle (at predetermined intervals) (e.g., 50 ms), andthe corresponding icon is displayed in accordance with the shakecompensation mode under execution.

First, in S101, the camera system controller 118 determines whether theimage capturing mode is the moving image capturing mode or the stillimage capturing mode. If the image capturing mode is determined to bethe moving image capturing mode, the processing proceeds to S102. InS102, the camera system controller 118 checks whether or not the shakecompensation mode under execution is the tripod mode. If the shakecompensation mode is determined to be the tripod mode, the processingproceeds to S107, and the camera system controller 118 displays thetripod mode icon. Note that, as shown in FIG. 3, the tripod mode existsin both the still image capturing mode and the moving image capturingmode, and the same icon is used as the tripod mode icon in the stillimage capturing mode and the moving image capturing mode. However, anicon for a shake compensation mode existing both the still imagecapturing mode and the moving image capturing mode, such as the tripodmode, may differ in the still image capturing mode and the moving imagecapturing mode. In S102, if the shake compensation mode is notdetermined to be the tripod mode, the processing proceeds to S103, andwhether or not the shake compensation mode under execution is theconstant point capturing mode (fixed point capturing mode) is checked.If the shake compensation mode is determined to be the constant pointcapturing mode (fixed point capturing mode), the processing proceeds toS108, and the camera system controller 118 displays the constant pointcapturing mode icon (fixed point capturing mode icon).

In S104, the camera system controller 118 checks whether or not theshake compensation mode under execution is the shift shake correctionmode. If the shake compensation mode is determined to be the shift shakecorrection mode, the processing proceeds to S109, and the camera systemcontroller 118 displays the shift shake correction mode icon. In S104,if the shake compensation mode is not determined to be the shift shakecorrection mode, the processing proceeds to S105, and whether or not theshake compensation mode under execution is the large shake correctionmode is checked. If the shake compensation mode is determined to be thelarge shake correction mode, the processing proceeds to S110, and thecamera system controller 118 displays the large shake correction modeicon. If the shake compensation mode under execution does not fall underany of the shake compensation modes determined in S102 to S105, thenormal moving image mode is under execution, and accordingly, in S106the normal moving image mode icon is displayed. Lastly, in S118, theicons for the shake compensation modes that are not under execution areremoved. The above is the determination flow for the shake compensationmode icon display during moving image capturing.

Next, the icon display flow during still image capturing will bedescribed. In the case of the still image capturing mode, the processingproceeds from S101 to S111. In S111, the camera system controller 118checks whether or not the shake compensation mode under execution is thetripod mode. If the shake compensation mode is determined to be thetripod mode, the processing proceeds to S115, and the camera systemcontroller 118 displays the tripod mode icon. Here, in the presentembodiment, the same tripod icon is used during moving image capturingand during still image capturing, but different icons between therespective image capturing modes may be displayed. The same applies tothe shift shake correction mode icon described later.

In S111, if the shake compensation mode is not determined to be thetripod mode, the processing proceeds to S112, and whether or not theshake compensation mode under execution is the panning mode is checked.If the shake compensation mode is determined to be the panning mode, theprocessing proceeds to S116, and the camera system controller 118displays the panning mode icon.

In S112, if the shake compensation mode is not determined to be thepanning mode, the processing proceeds to S113. In S113, the camerasystem controller 118 checks whether or not the shake compensation modeunder execution is the shift shake correction mode. If the shakecompensation mode is determined to be the shift shake correction mode,the processing proceeds to S117, and the camera system controller 118displays the shift shake correction mode icon. If the shake compensationmode under execution does not fall under any of the shake compensationmodes determined in S111 to S113, the camera system controller 118determines that the shake compensation mode under execution is thenormal still image mode, and advances the processing to S114. In S114,the camera system controller 118 displays the normal still image modeicon. Lastly, in S118, the icons for the shake compensation modes thatare not under execution are removed. The above is the determination flowfor the shake compensation mode icon display during still imagecapturing.

Note that is the icons corresponding to all shake compensation modesunder execution are displayed, for example, the processing may beadvanced from S107, S108, S109, S115, and S116 to S103, S104, S105,S112, and S113, respectively. In this case, it is determined whether ornot the shake compensation mode in execution is normal moving imagemode. If it is determined to be the normal moving image mode, the normalmoving image mode icon is displayed. Also, in S114, it is determinedwhether or not the shake compensation mode in execution is normal stillimage mode. If it is determined to be the normal still image mode, thenormal still image mode icon is displayed.

Note that when deciding the icon to be displayed, determination of theshake compensation modes may be frequently switched depending on theimage capturing situation. In that case, if icon display is frequentlyswitched in accordance with the switching of determination, a user mayfeel uncomfortable. Therefore, in the present embodiment, display may beswitched if the same shake compensation mode is selected several times:for example, the icon display may be decided if the same shakecompensation mode is selected consecutively for a predetermined numberof times (e.g., three times). For example, if the shake compensationmode corresponding to the currently displayed icon is terminated and itis confirmed consecutively for the predetermined number of times atpredetermined intervals that this shake compensation mode has stopped,the camera system controller 118 removes the corresponding icon display.Similarly, if execution of a new shake compensation mode whose icon isnot currently displayed has started and it is confirmed consecutivelyfor the predetermined number of times at predetermined intervals thatthis new shake compensation mode is under execution, the camera systemcontroller 118 starts the corresponding icon display.

The above-described processing can be implemented by, for example,adding the processing shown in FIG. 7 prior to S101 in FIG. 6. First, inS501, the camera system controller 118 selects one of the shakecompensation modes. In S502, the camera system controller 118 determineswhether or not the on/off state of the selected shake compensation modeagrees with the previous on/off state. For example, the camera systemcontroller 118 stores the previous on/off states of the respective shakecompensation modes in a RAM provided therein (hereinafter simplyreferred to as RAM) that is not shown in the figure. The camera systemcontroller 118 determines whether or not the on/off state of theselected shake compensation mode agrees with the on/off state stored inthe RAM. If the current and previous on/off states do not agree witheach other, the processing proceeds to S503. The RAM is provided withcounters for the respective shake compensation modes as well as theabove-described on/off states, and in S503 the camera system controller118 resets the counter corresponding to the selected shake compensationmode. In S504, the camera system controller 118 stores the currenton/off state in the RAM. After that, the processing proceeds to S508.

Meanwhile, if in S502 the current on/off state is determined to be thesame as the previous one, the processing proceeds to S505. In S505, thecamera system controller 118 increments the counter corresponding to theselected shake compensation mode by 1. In S506, the camera systemcontroller 118 determines whether or not the counter value is equal toor larger than a predetermined value. If the counter value is not equalto or larger than the predetermined value, the processing proceedsdirectly to S508. If the counter value is equal to or larger than thepredetermined value, in S507 the camera system controller 118 updates anon/off flag corresponding to the selected correction mode in accordancewith the current on/off state.

In S508, whether or not the above-described processing has beenperformed with respect to all shake compensation modes is determined,and if any shake compensation mode has not been subjected to theprocessing, the processing is returned to S501 and the above-describedprocessing is repeated on the new shake compensation mode. After theabove-described processing is finished with respect to all shakecompensation modes, the processing is advanced to S101 in FIG. 6. Notethat in S102 to S105, S111 to S113, and S118 in FIG. 6, whether therespective shake compensation modes are under execute or not underexecute is determined based on the status of the on/off flag.

As described above, the image capturing apparatus according to thepresent embodiment is capable of selectively executing an optimum shakecompensation mode suitable for the image capturing situation duringmoving image capturing and still image capturing, and clearly notifyingthe user of the execution status thereof.

Other Embodiments

Note that in the above-described embodiment, the digital camera capableof capturing still images and moving images has been described as theimage capturing apparatus, but the image capturing apparatus is notlimited thereto. For example, the present invention can be applied alsoto electronic devices such as game machines having an image capturingfunction, communication devices such as mobile phones having an imagecapturing function, and the like, and the same advantage as in theabove-described embodiment can be obtained.

As described above, according to the above-described embodiment, anadvantage that a user can easily recognize the status of image blurringcorrection under execution is achieved.

Aspects of the present invention can also be realized by a computer of asystem or apparatus (or devices such as a CPU or MPU) that reads out andexecutes a program recorded on a memory device to perform the functionsof the above-described embodiment(s), and by a method, the steps ofwhich are performed by a computer of a system or apparatus by, forexample, reading out and executing a program recorded on a memory deviceto perform the functions of the above-described embodiment(s). For thispurpose, the program is provided to the computer for example via anetwork or from a recording medium of various types serving as thememory device (e.g., computer-readable storage medium).

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Application No.2011-179208, filed Aug. 18, 2011, and No. 2012-150752, filed Jul. 4,2012, which are hereby incorporated by reference herein in theirentirety.

What is claimed is:
 1. An image capturing apparatus having a pluralityof image blurring correction modes, comprising: a correction unitconfigured to select an image blurring correction mode from among theplurality of image blurring correction modes in accordance with an imagecapturing situation and execute the selected image blurring correctionmode; and a display unit configured to have a plurality of display itemsrespectively associated with the plurality of image blurring correctionmodes, for selecting a display item corresponding to the image blurringcorrection mode under execution by the correction unit from among theplurality of display items, and display the selected display item on adisplay screen.
 2. The apparatus according to claim 1, wherein in casethat two or more image blurring correction modes among the plurality ofimage blurring correction modes are under execution simultaneously, thedisplay unit selects one of the display items corresponding to the twoor more image blurring correction modes and simultaneously displays theselected display item on the display screen.
 3. The apparatus accordingto claim 2, wherein the plurality of display items are assigned, inadvance, display priorities based on their corresponding image blurringcorrection modes, and in case that two or more image blurring correctionmodes among the plurality of image blurring correction modes are underexecution simultaneously, the display unit displays a display item of ahighest display priority among the display items corresponding to thetwo or more image blurring correction modes.
 4. The apparatus accordingto claim 1, wherein the image capturing apparatus has a moving imagecapturing mode and a still image capturing mode, and at least one imageblurring correction mode is different between a group of a plurality ofimage blurring correction modes for the moving image capturing mode anda group of a plurality of image blurring correction modes for the stillimage capturing mode.
 5. The apparatus according to claim 4, wherein thecorrection unit selects an image blurring correction mode to be executedfrom the group of the plurality of image blurring correction modes forthe moving image capturing mode while the moving image capturing mode isunder execution, and selects an image blurring correction mode to beexecuted from the group of the plurality of image blurring correctionmodes for the still image capturing mode while the still image capturingmode is under execution.
 6. The apparatus according to claim 1, whereinin case that it is confirmed consecutively for a predetermined number oftimes at predetermined intervals that an image blurring correction modecorresponding to a displayed display item has stopped, the display unitremoves display of said display item.
 7. The apparatus according toclaim 1, wherein in case that it is confirmed consecutively for apredetermined number of times at predetermined intervals that an imageblurring correction mode whose corresponding display item is not beingdisplayed is under execution, the display unit starts to display thecorresponding display item.
 8. An image capturing apparatus having amoving image capturing mode and a still image capturing mode, andexecuting a plurality of image blurring correction modes, comprising: acorrection unit configured to select an image blurring correction modefrom among the plurality of image blurring correction modes inaccordance with an image capturing situation and execute the selectedimage blurring correction mode, a group of a plurality of image blurringcorrection modes for the moving image capturing mode and a group of aplurality of image blurring correction modes for the still imagecapturing mode respectively including at least one different imageblurring correction mode; and a display unit configured to have aplurality of display items respectively associated with the plurality ofimage blurring correction modes, for selecting a display itemcorresponding to the image blurring correction mode under execution bythe correction unit from among the plurality of display items, anddisplay the selected display item on a display screen, wherein an itemto be displayed is different between the moving image capturing mode andthe still image capturing mode.
 9. The apparatus according to claim 8,wherein the plurality of display items are assigned, in advance, displaypriorities based on their corresponding image blurring correction modes,and in case that two or more image blurring correction modes among theplurality of image blurring correction modes are under executionsimultaneously, the display unit displays a display item of a highestdisplay priority among the display items corresponding to the two ormore image blurring correction modes.
 10. The apparatus according toclaim 8, wherein the correction unit selects an image blurringcorrection mode to be executed from the group of the plurality of imageblurring correction modes for the moving image capturing mode while themoving image capturing mode is under execution, and selects an imageblurring correction mode to be executed from the group of the pluralityof image blurring correction modes for the still image capturing modewhile the still image capturing mode is under execution.
 11. A methodfor controlling an image capturing apparatus having a plurality of imageblurring correction modes, the method comprising: a step of selecting animage blurring correction mode from among the plurality of imageblurring correction modes in accordance with an image capturingsituation and executing the selected image blurring correction mode, anda step of selecting, from among a plurality of display items that arerespectively associated with the plurality of image blurring correctionmodes, a displayed item corresponding to the image blurring correctionmode that is under execution in the executing step.